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Proxy Content Editing System 



Field of Invention 

This tnvention generally rela.es to digital archives, and more particularly, to the drg.tization, 
cataloging, storage, access, retrieval and editing of content such as vtdeo data. 



Background 



Players in 4 — ta*dia — such * P 0 **" 8 of — W 

ma y have thousands of hours of video content at their disposal. For example, a well-known 
revision entertainment program reports possession of 100,000 hour, of video content and adds 
approximately 60 hours per week. 

Such programming often demands that the video content be available for editing in a very 
short timeframe. For example, a first segment of an entertainment television program may 
already be airing while a second segment is strll in production. In this fast-paced environment, 
fast access to the information becomes critical. 

Unfortunately, video content currently exists on videotape in either analog or serial digital 
format, hampering efficient access and review of the v.deo's contents. The degradation of the 
origmal anaiog recordings is an even greater concern. Storing the information in a dtgita, archive 
permits faster access to the information and reduces the problem of degradation. 

To meet production quality, the mformation must be drgttized a, a high or broadcast 
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provides a high quality content stream suitable for televistng. 

searching. 

, ^ salS odesira b ietoprov id eawe b W d v, d eoe di tin g s y ste m rea dlly access lbl eto 



users. 



Description of the Drawing 

invention, including ingest, storage an<3 retrieval stages; 
Fig 2A is a block diagram representing the ingest stage; 
Fi , 2 Bisareprese„,at,ono„^^ 

segment of content; 
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Fig. 3 is a flow diagram representative of the ingest process; 

Fig. 4 is a block diagram representing the storage stage; 

Fig. 5 is a block diagram representing the storage and retrieval stages; 

Fig. 6A is a flow diagram representing the edit/selection process; 

Fig. 6B is a representation of an edit decision list; and 

Fig. 7 is a flow diagram representing the recall process. 



Summary of the Invention 

■ Th e present invention provides an end-to-end section for digitizing existing vdeo 
^^^^^^■^^^^^^^ 
twoparaHei paths. high ^utic. ib^ 8 shown on U. rigb, -»» W 

aeptcted on the .eft, stores a compressed vtdeo summary and tex, descriptions intended to 

at the beginntng by the video source U, and during the retrieva! process viaEDL 31. 

inges,. The ingest stage ,0 bandies the digitization of the incotntng data from existing 
videotape content and optionahy, may provide mechanisms for segmenting the vtdeo and 
augmenting any descriptive information aheady associated with the content. The vtdeo is 
^^^^^^^^^^^ 
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mayb e d o n ea Sa se P a r a t es t ep ft o mth e in U ia n„ g es t w h e nth e re co r ae d speec hi n th ea^ 

stream is being processed. 

The MPEG1 and the metadata are used for proxy editing, i.e., to search and browse the 
vl deoda, af orse l ect,on,whi l e, h eMPEG2is used for fi na, edtt.n, and As a resuit, 
me time codes between the MPEG! and MPEG2 are synchronized. 

Th e in p U t S tothe 1 n g estoperat 1 o„co m p„se: 1) the output ,4 of a v ld eo source ,1 such as 
avld e 0 ,apereeorder(VT R ), 1 nciudi„ g2 au dl o 1 np U tpath S ;2„eou, P u, 15 o f a, ! mecode 

f DOS Xbase legacy database. It may be provided from any anting 
IBM DB2 database from a DOS Xbase legacy u 

jr archive, e.g., proprietary or standard archiving systems aheady in use. 
The outputs from the mgest operatton mchtde: 0 an MPEG2 I-Frame oniy data stream 
16fo re X a m ,eat4Bme g ab 1 tsperseco„d(Mbps ) nom 1 na 1 ,provi d ingtheMPE G 2 P a,h ; 2,a„ 
M P EGld a,as,ream,fore X amp l ea, 1 , M bps,forprov idl ngtheMP E 0 1/ metada,apa,h ; a„d3 ) 

MPEGl/meta data path, both indicated by arrow 17. 

-4- 
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integrated IBM Video Charger media streaming product. 

^ContentManager^prov.desan.n.erfaceforseare^and— g rhe v.deo meta 

dataT he— s and te*. descripttons that are presented as par, or the search resnUs are 

disk and accessed as needed via the Content Manager 22. 

, t . , and the batch recall operation represented by 
depicted by block 32 in MPEGl/meta data path 6, and the 

recall station 33 in MPEG2 path 8. 

Th eed W se 1 ec« i o„opera, I on32ena bl esprod U cers t osearchand b rowset h ed 1 g,t 1 zed 

vld eoo ft heseene.Thev 1 deow i n b e gl n Pl a y ,nga„hescenese l ected. i th 1 n,hestor yb oard. 

As ,he P roducer reviews thedata, he indtcates which segments he would ,*e ,o use b , 
piacngthemtntoac—Ust.Theproducer.sthena.etoorderandtr.mthevtdeo 
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Decision List (EDL)31. 

The EDL 31 is sen. Co the batch remeval operation 33 ,n MPEG2 path 8. The batch 
retrieval operation 33 uses the EDL 3 1 to retrieve the appropriate segments from the MPEG2 
st ora g earea21. The data are retrieved from tape and sent to a Profile system 34 for s„bse q uent 

transmission to an edit bay 35 for final editing. 

Although the rnvention is described with an exemplary two paths for high and low 
resolut.onformats.thepresen.embodimentincludesthreeresolut.ons.Thumbna.lsarestoreda, 

a „ even lower resolutton than the MPEG 1 content, and are used in the selection and ed.tmg 
processes. Moreover, the generated concept of the present invenfon easily extends to 
supportingmultipleresolut.onformats.Ausermayusecontentstoredinoneormorelower 

resoiutionformatsforselectingport.onsofcontent.Therecailprocesscanthenretrieve 
correspondrngportionsofthe selected contenttn any of the stored h.gner resolut.on formats for 
production using the principles taught by the invention. 



Detailed Description 



The present inventton w,„ now be descnbed with reference to a specific embodiment, and 
part.cularlytov.deo con.ent.lt sha„ be understood, however, that vanous mod-ficafions and 

appended claims. Moreover, ,he .nven.ion is suitable for managing al, types of content. 



I. Ingest 
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v.deotapesorfromlive video feed, andcollects descriptive mformation tha, may be provided, for 
example, from operator input, exrsting descript.ons, or vtdeo image cap.ures to create a 
storyboard and/or speech-to-tex. processing of the audio stream. 

Ing es. Hardware. Referrrng now to Fig. 2A, there are some number n of v.deo ingest 
sta ,,ons40. in the present embodiment, four statrons were provided, aithough more s.ahons may 
be supported depending on network and server capacity. 

Each station 40 consists of a video' tape recorder (VTR) 4 1 connected to a PC based 
workstation 42 capable of linking to a network (in this case running Microsoft Windows NT). 
The workstation or .nges, PC 42 inc ,udes a low resolutron encoder 45 and driving video 
cataloging software (descr.bed more fully below, In the present embod.ment, the low resolutton 
encoder is a PCI MPEG1 encoder card. 

The station 40 tncludes a link 43 to a high resolution encoder .3. In the present 
embodiment, the hnk rs an etherne, or RS422 connection and the high resolution encoder 13 
comprises an MPEG2 encoder. Station 40 may also provide a control link 47 to the VTR, for 
example with another ethernet or RS422 connection. 

The high resolution encoder 13 of the present embodrment supports encoding of multiple 
MPEG2 streams, so that one machine may servrce several of the vrdeo tngest units. ThePCI 
cards for MPEG1 encod.ng and vrdeo processrng in the present embodiment are compatrble with 
scene detection and speech-to-text software (see below). 

The station 40 interfaces with the high resolution encoder ,3 to enable simultaneous 
conversronofthe analog video stream to low and high resolution formats, in thts case MPEG 1 
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^MPEOXPrionobe^inpuuoHigh— „ encoder ,3, the analog stream ,4 or the 
encoder 13. 

The high resolution encoder 13 of the present embodiment provides both MPEG2 

low resolution encoder 45 over link 43 . 

A s P rev,ous ly no,ed, t heh lg hreso,ut.o„and,ow reS o,ut 1 onstrea m sl6,nneed,obe 

synchrony. The present embod.ment uses tmrecodes to synchrony the two. However, 

provtdestimecodesto h, g h region encoder ,3. Thetimecode generator 44 may bepartofthe 
high re— encoderBasmthe present embodtmen, 

provl dedby the VTRitseifor already be present rnthe video tmages.ln.helattercase.such 

Th e ttmecodesofthe present embodiment com P ri S eSMPTE,imecodes.H 1 ghreso,u„on 

encoder 13 encodes the ttmecodes into the generated MPEG2 stream, and superimposes 
..mecodesintotheanaiogvideormagesthemseWes.e.g.byburningthetimecodesusinga 

-8- 
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See t orexa m p,e,co mm onlyass ig „edUS.Pa t e„,no.5325,89 2 .oBraudawa y e ta l.,e„ tl Ue d 

extracted from the MPEG 1 fUes by using proprietary MPEG 1 encoders and in.egrat.ng the 

proprietary MPEG1 standard of the encoders with Videocharger. Although 
emb od.n,entnew.. m ecodeswerege„era,ed,preexi,i n gnonco„.,„uous.ir„e C odeso f .hev 1 deo 

im a g eswerea,sosuppor,eda„d b urnedin,o,heMPEG lim a g es b ecause,hecus,o m erhad 

indexed to these timecodes. 

Regardless of the MPEG1 solution used, the encoding process needs to ensure , ha, the 

^^^^^^^^^^"^ 
subj ect to the capahilittesofthe chosen hardware and software. In the present embodiment, a 

e g during thumbnarlor storecard generation, and detects its timecode (e.g., through OCR 
technology.w—decodrng.etcOThesoftwarethenloo.suptheMPEGlfrarnenu.berfor 

th ec„rren<frame. Then, ,f the system already tnows the starttng frame andt.nrecode of the 
..dectcancalculateacorrespondanceor-delta-.mto the metadataf.es associated wtth the 

MPEG2 files. Alternatively, another sample frame and corresponding t.mecode mformation are 

»a to ralrulate the delta. This delta is later used 
determined and the two calibration points are used to calculate 

to calculate an offset into the MPEG2. 

*c nf the the MPEG 1 and MPEG2 files is shown in 
An example of corresponding segments of the the Mraui 

-9- 
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numb e r o f i mag es,eac h associa t e d wi th a fram e„ Umb e r w h ,c hl n t h IS case i ss l o red w 1 « hth e 
metadata associated with the .mages. A representative ,ma g e frame 102 is shown, and has a 
Renumber ,072. An — vewiOSorthe^e^e^soshow, ft.ndudes a 
lim ecoael« S upe„ m posedo„the im a g efra I ne.The r ep re sen t a ti ve, i n 1 ecooe,04 [ eads 

"OrOO'50 02", indicating that the image frame is 50 seconds and 2 frames into MPEG 1 stream 

mesystemisabletocaiibratei.sdf so thatitcan calculate the appropriate decodes 
correspond,^ an y frame numbers. It can then find the corresponding frame 106.ntheh.gh 

resolution MPEG2 file 105. 

The hardware used to impiement the present embod.ment of the invention comprised four 
] BMPCs,oneMP E G 2 e„coders y stem(e.,Prof,,eXP,s U pport.ng4MPEG2strea mS , f onrPCl 

MPEG1 encoder cards, and four 100BaseT Ethernet adapters. 

Ing es, Software. The .ngest application software may be implemented in a number of 
ways The sof,wareo f thepre S e„,embod,mentco„sistsof several customized and .ntegrated 
modules: Microsoft Windows NTWor k s,at.on4.0w / serv,epacKs,V,a g eVideoLog g .ng 

,,,, T „ va c or C++ compiler compatible with 
Software w / SDK, IBM Content Manager V6.1, Java, C or C++ 

Thebaseofthesoftwareisprov.dedby.heV.ragev.deo logger and its Software Developer, 
Too, k i«SDK),al,hou g h other software prov.ding s.mi.ar funct.ons may he used. The urges, 

for eachv,deoandfeedsitin,oa,oaderfortheConte„ t Mana g er22.Itfurthere„sures,ha«the 
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M P EG1 a„dMPEG2e„code r sa r e tep ,s y „*o„ized t o, h ee X ,e ma , t , m eco d ,Co„ t en, 
Manag e r22 ,nc 1 ude S a, i brar y se [ ve r ,a ( e XlS ea rch server, V,deochar g er and a chette. 

Additional Software Database Functions. In the present embod.ment, severai 

vol cea„„o t a, 1 o„u S i„ g sof,waresuchasV,aVo 1 eebymMCorpora tl o„,or b yn li x l „ g a 

standard database tools that are outside the scope of the system. 

I » g e S tPr«es,Re f e m n g „o Wt oF lg .3,,hefonow i „ g stepsou,Unethe P rocess i n g of 

each video tape. 

AnIng est operator seiectsatape for process,, based upon predetermined 

ThenntquetapetdentrfrerrsenteredrntothelngestappUcatron. The 
, d e„, lfi erw ll ,beuseds U bse q „ent l yto q ue r yCo„ t e,Mana g er t oretr 1 eveex 1 st I n gm etadata 

MPEGiencodrn, hardware on the In g est PC. The appheatron wiii aiso ini.^e the Prof.ie 
M P EG2eneoderbysupp l yin g ,tw 1 ,hf 1 ,ena m ea„ddes tI na, 1 on l oca,ioninfor m at 1 o„. 

p,,^ Thern.estopera.orloadsthetaperntothe.apepiayer. Each videotape of 
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lhe present embodimen.isonly read once, and the tapeplayer output is sen, to two separate 
inputs: the Ingest PC MPEG, card and the Profile v.deo format. Both encodings tnus, share a 
consistent ,,me code provided by a time code generator 44, as previously described. 

After encod.ng, the MPEG2 stream is stored ,n a file residing on the Profile storage 
system. From there it ,s transferred to the MPEG2 storage system and onto magnetic tape. The 
Ingest PC and MPEG1 encoder produce an MPEG 1 stream stored in a file digitized at 1.5 Mbps- 
The me,a data eonststs of several items: a storyboard, a pr.mar.thumbnail, text orig.naHy 
fr0 m the legacy database (optionally mod.fted, used to store ^formation aboutthe vrdeo content, 
an audio trade speech-to-text transcript, optionally a Microsoft Word or other word processing 
fonnattranscript.andopttonallyaspeech-to-textannotation. The meta data of the present 
embodiment is stored in such a way , ha, i, ,s associated w,th theMPEG, file, s.nce it will 
pritnanly be used for vtew.ng and selecion purposes. The Inges, appl.cation and ,,s user 
interface facUUate collection of the metadata and hide the detailsofthe disparate components 

interacting underneath. 

Primary Thumbnail. The primary thumbnad ,s initially represented by an icon 
deterrmned from an attribute value. The specific icon values are determined as par, of the 

Users are also able to edit other metadata via thts editing .nterface, as w„, be descrtbed ,n more 
detail subsequently. 
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• • 

Storyooar,. Scene detection technology within the video catalog software marks scene 
changes w.th.n the v,deo and creates a thumbnail of the firs, fra m e of each scene. Alternatively, 
thumbnails may be captured at a fixed interval. For example, in the present embodiment, a 
thumbnail is created for every 30 seconds of video using an AVI encoder. The collectton of 
,hese thumbnails forms a storyboard for the video. In the preferred embodiment, a webpage 
stor yboard is burlt at the tune the thumbnatls are created, or otherwise as a background process, 
so that it can be tmmediately retrieved during the selection process. 

Legacy Tex, The desenptive data originally loaded from the legacy database is displayed 

for operator review and editing. 

Transcription. Speech-to-text technology withtn the video cata.og software processes the 

searching. Closed caption encoding may also be captured if des.red using alternative software, as 
the Virage software product does not support this function. 

Some video assets also have transcripts in Word or other word processing formats. These 
transcrtpts, when available, are supplemental to the speech,o-«ex. output and are also used as 
input for text searching. The Ingest appiicatton provides a place to specrfy any existing transcript 
files and expects the files to be accesstble on the file system. Once these transcript files are 

in more detail subsequently. 

S P eecH-to-Te*< Annotation. Optionally, an operator can annotate the vtdeo via verbal 
descriptions which wil, also be captured using speech-,o-«ex, technology. Thts annotatton may be 
done subsequent to the completion of the speech-to-text capture. 

When the processtng of a story has completed, the resulting files are ready 
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for final d.spos.tio. The MPEG . file, .ex. me.a da.a, .humbnails, s.oryboards and 
spe ech-,o-te X ,ouiputare grouped together and presented to user for final review. The user m ay 
spot check .he ou.pu.fo. accuracy and q „aH. y before su bmi .. i „ g . h ed,afo r ,oad,n gi n,o .he 

IBM Co„.en.Ma„a g e, At this point the user is able to further modify attribute data from the 
, eg acy database as well as de.erm.newhe.her the encoding q uali,y is acceptable or needs , be 
repeated. 

Once .he end of ,he v.deo .ape ,s reached, the appl.cat.on ,s rese. ,o i.s .ntfia, s..e and ts 

ready for the next tape. 

The ingest operation must be ableto process the vrdeo suffic.en.ly c,ick,y tha. the tape 
p ,ayer can run continuously and each .ape only be played once. The four-,at.on ingest system of 
is designed .o perform .he rnges, process 16 hours/day, 6 days/week a. 4 



8-10 hours of video/day. Additional stations may be added 



the present embodiment 
ingest stations. Each station encodes 
as data throughput allows. 

II. Storage 



StoragecapacUy, an .mportant aspect of the present —n. For example, to encode 
m 000hoursof^^ 

the total solution requires over 2 petabytes of storage. 

^entcapacUy^utalso must be able t0 effrc.ently transfer fHes from mgest to tape and to 

fn«t access must be provided for the MPEG1 path, whereas slower access 
fulfillment. Moreover, fast access muM uc yi 

is tolerable for MPEG2 retrieval. Below are descriptions c 
SVL920010023US1 " 14 " 
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lhe present embodtmen, for bo. MPEG , and MPEG2, although numerous storage -« 

may be implemented to address the preceding needs. 

Storage Area Ne. W orMSAN). Referrtng to Fig. 4, the present embodiment provides a 

sig „ lfi cant amount of disk storage for several systems on different platforms. S.nce large 
amountsof data move oetween the system, a flexible, scalable, storage architectnre was 

cemented. The 1 .5 TB of storage comprises 700 GB IBM Videocharger on AIX 62, 200 GB 
IBM Content Manager dtgttal library on AIX 6L and 600 GB provtded by aTtvoli Storage 
Manager (TSM) 2 1 coupled to a Linear Tape-Open (LTO) Tape buffer 63, both on AIX. 
Additional 100 GB or more are available on the htgh resolution encoder 13. 

A SAN devce 64, here comprising .7.33-1*0. consoles the storage which interfaces 

^^^^^^^^^^^^ 

ran0 utof space and do no, have excess space. A systems storage can be mcreased whhout 
opening it to add more drives. The SAN provides RAID, hot-swap, hot-standby, redundant 

. do e S „o,prec,udeaccesstotheda,, W *^~^*'^">>*~~- 

Storage of MPEG 1 Files and Meta Data. The MPEG1 files and associated meta data passed to 

storage systems via l.n, 66 and are stored, an ,BM V.deocharger Model 62 managed by the 

« V6 1 22 As shown the IBM Content Manager solution restdes on two 
IBM Content Manager V6. 1 22. As snown, u.c 

a rY A 1 ?• one for the digital library portion 61 of the 
Model H50 R/6000 machines running AIX 4.3.2. one tor s 

Content Manager and one for Videocharger 62. 

Stag.ng and buffering occur on disk. The LTO Tape Ltbrary 63 andTSM 21 are 
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connection is a,so provided. Thumbnails and metadata used for search results are kept ond.sk ,o 
ensure efficient search times. The VC provides disk buffer capacitor ,000 hours ofMPEGl 
video available for tmmediate streaming. Addittonal video is staged from tape. 

Storage of MPEG2. The MPEG2 data of the present embodiment is stored on a R/6000 
system running AIX and TSM. The high resolution encoder 13 is connected toTSM 
channel connection. Inttta, staging and buffering is to dtsk w„h an LTD tape library 63 for long 
term storage. 

III. The Edit/Selection Operation 



The Edit/Selec.ion operation ispart of the retrieval process 30 shown in Fig. 5. A video 
edtfng system is hosted on one or more servers 68 and can therefore operate without custom 

software on the edit/se,ection client machines 32. A p.ural.ty of edi.selection stations 32 are 
provided to facilitate the location, review and selection of archtved video assets. This 
web-based system enables collaboration between video edUors, al.owing them to share sets of 
video dips. It also allows muUiple users to share the same collection of v.deo storage hardware 
20, video content, vtdeo processing hardware 34, and video software. 

A producer searches content via, for example, tex, strings and keywords, and then 
re views the returned thumbnails, text descriptions and storyboards to narrow down h,s selections. 
Once suffic.ently narrowed, he can vtew the MPEG1 v.deo to make final decisis on whtch 
segments to use. Selected segments are then p,aced in a candtdate list for use in generating an 
EDL. The producer is able to view, select, trim and order segments from the candidate lis, to 
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produce the final EDL3,. A, any point in .his process, the producer can prevrew the current 
EOUTHeresuH^EDLissenUoiheHrsh — recan process 33overSAN 64 ana use, as 

a reference for indicating which MPEG2 files are to be recalled from tape. 

The search, browse and EDL creatron operations of the present embodiment are prov.ded 
vl aaco m bi„a,,onofWeb,Java and/or C applicauons, for example. The fma, EDL 3 1 format 
may be tailoredtotheneedsofthe user, whichin turn may depend, for example, upon the 
existing user applications. The EDL 3 1 consists of a stmp.e non-hierarchical lis, of vtdeo 
segments with file names and start and stop timecodes. 

EdM/Select Hardware. The Edit/Selectton stations 32 each consist, for example, of ■ 
perso„a,compu«ersrunnin g Windows98andaWe b browserwi,h Java ,.,.8 capability. 
Dependtngonthesoftwarechosen.addttionalPC.cardsmaybe.ncluded.In.hepresen, 

embodiment, 25 stations are configured to run Edit/Selec, operations concurrently. 

Edi.ZSe.ect Software. The Edit/Selecon station 32 software tntegrated several 
underlying components, induding Interne, Exp.orer V5.0, Java Runtime Environment 1.1.8, 
IBM's Net.Data and MPEG1 Player. In the present embodiment, the search functions are all web 
based vra Net.Data while the v.deo selection ts made with a modtfied version of the 
VideoCharger Player running locally. 

The edit/selection software prov.des a user interface and several underlying functions for 
anowmgtheuserto perform text-based searches, rev.ew the resuhs, select segments therefrom, 
generate EDL's and then send final EDL's to the MPEG2 recall operation 33. A diskette-based 
d.stribution of the EDL is also supported for standalone Edit Bays 35. 

EDL's 3 1 are saved on the web server 68, so that they can be shared with other users. 
They may also be access-protected so that other userscan be resumed from accesstng or 
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modifying them. 

Addit.onal functions of the edition software allow users to search the archive and 
upd ate the metadata assorted with each v.deo. In particular, users are able to replace 
thumbnatls, and modtfy legacy attr.bute data and text sources produced from speech-to-,ex, 
a„no,a,io„andvideoana,ysis. Textts m odif,ed, for example, v,a keyboard input. Thesearch 
clien ,is an apphcatton connecting to the Content Manager digital hbrary 61 and V.deocharger 



62. 



Edi.yse.ec. Opera,i.„. The Edit/Selectton process will now be descnbed with reference 



to Fig. 6A. 



ljmm ^ At initialization, the program performs functions such as clearing the 
c urren,EDLand request^ 

used to coordtnatetheacttvities between the Edi.Selection operation, the MPEG2 reca.l process 

33, and the edit bay 35. 

j^t^ry^ The producer starts by entering words or phrases representative of the 
subject he rs,oo kl n g fo,Thrs input is used to create a query that is sent to Content Manager 22 
for process. Content Manager 22 returns a sc, of cand.dates ranked by how closely they 
matchthequery. Each candidates represented by a thumbnaii and mcludes the descrrpt.ve text 
entered at Ingest 10. Because of the s.ze of the text, a subset of the candidates may be presented 
with addhional pages as needed. Alternative formats are also possible. 

The exact .mplementat.on the text query and search results are dependent on the 

turn depend on customer requirements. 

' SlagintIPj£j ^^ when.tisknownthattherewillbedernand 
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TofaoUUa.e.hU.producercHibranansperfon, searches on the t opics t os t a g e lh eco rr espo„d 1 „ g 

^^^^^^^^^^^ 
recalnngitfrom tape to dtsk for fas, future access. Therefore the ed.t/selection processof t he 
present embodtment supports both play and stage or fetch revests. The play operation p.ays the 
v ,deo,n the MPEG, Player, wht.e the stage operation on,y fetches the v.deo ,nto a Videocharger 

disk, although more may be added depending on user requirements. 

mk:M3m ^ The producer reviews the thumbnails and descr.pt.ve data and 
dec ,des whtchcandrda.es warrant further invention. He clicks on the thumbnail to select 
for further processing. This creates a storyboard. The storyboard consists of the set of 

associated vtdeo file will is staged to the V.deccharger server 62 for faster v.ew.ng should the 
producer choose to view the MPEG1 video. 

^S^^M The storyboard appears as a series of thumbnails each of which 
represents scenes m the v.deo (as determ.ned previously by the ingest v.deo loggmg software). If 
the Aboard leads to continued interest, the producer c.icks on the relevant section to trigger 
th eP,ayerfor,heMPEG. . The Player fetches the vtdeo from the VC server and begms play.ng 

the video at the selected section. 

Ssm C^M sm 3L The Player loads and beg.ns playing theMPEGl video at a point 
conststentwtth the thumbnail in the storyboard. The producer can p,ay the video or can jump to 
spec.ficlocat.onsandplay^^ 

SVL920010023US1 ' 19 ' 



^ress Mail Label * EF271823164US 

thecurren.s.orvslu^he proceeds ,„ ,he MPEG1 Revtew andEDLcrea.ion s.ep 87. 

Bsa ^ 3£EeuQaS£ ^^ The MPEG 1 Rev.ewandEDLcrea.ipns.ep87 

comp le.e, .he resu,.,n g EDL ,s convened .o .he s.andard form, EDL a g reed upon. 

The Ed„Se 1 ec.a 1 en.32 P rov ld esa gra p U ca, user tn.erface ,o choose a video from .he 

b e g ,„„i„ g a n dend 1 „ gf ra m en Umb ers,henaddi.. 0 . h eEDUThes t ar.a n d,op, m esca„ b ese. 

Oncedonew.h one v.deo, another rs chosen and marked un,,! ah ,he des.red v.deos are added .o 
the EDL The videos i. .he EDL can .hen be reordered, removed or changed. 

A „ exemplary EDL.5is shown ,„ Flg . 6B. « ,s essenUa,,, a Hs. of seiec.ed v.deo 

umecodes themselves, as either read or calculated. 

,h, FDL can be played back in Preview Mode. If it does no. 
Throughout this process the EDL can be piayc 



list. 
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st0 p, pause, frame forward, frame backward, jump to a location, mark start, and mark stop. 

Additions, a slider contro, is provided to facilitate movement to various parts of the vtdeo. 

WrafcUfc Once the EDL creatton is complete the producer can request to save and 
optionally submiUheresultingEDL. At this time the followmg occurs: the EDL is converted to 
the standard EDLformat agreed upon, the EDLissavedtod.sk or the Content Manager server 
61 forexample, previewing and modifying at a later Ume. Upon submission, the EDL is 
sent to the MPEG2 recall facility 33 so that the corresponding MPEG2 video segments can be 
rem eved from the archive and sen, to the Profile decoding machtne 34. Acopy 38 tsalsosentto 

job. 

IV. The MPEG2 Recall Operation 

Referring to Figs. 5, 6B and 7, the MPEG2 Recall station 33 receives the EDL 31 from 

sta ,i 0 „33m 1 t 1 ates t hereca,.oftheMPEG2f,.esfromtape63,ostorageo„d 1 sk 2 l,as,ndica, rf 
by step 92. The starting and ending markers of each video segmentm the EDL are used to 
calculate byte offsets ,n,o the MPEG2 files residtng on tape. According to the present 
embod,men,,only, h edesired par, of the file is retrieved from tape 63 in order, increase system 
performance. Thts sub-file retrieval operation ts supported within theTSM client 21. 

The segment with handles is reformatted tn.o a valid Profile MPEG2 forma, file. Station 
33 then oversees proper delivery of the MPEG2 ,o the Profile Decoding Machine 34. 
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Recall Hardware. The MPEG2 Recall Station 33 of the present embodiment is a PC 
running Windows NT coupled to an IBM PC Server via lOOOBaseT Ethernet connectivity. It 
includes apparatus for extracting the timecodes from the low-resolution video segments specified 
in EDL's. It also includes a fibre channel card, example Interphase 5527. 



IBM and providing the previously described recall station functions. 

MPEG2 Recall Operation. The MPEG 2 retrieval operation will now be described with 
reference to Fig. 7. 

File Receipt 91. The Recall system 33 receives the EDL 3 1 from a server 68 coupled to 



IT File Processing. The application opens the EDL file 92 and reads the tape identifier for 

each segment 93. In a next step 94, the application checks the storage buffer to see if the file 
*2 segment is already buffered. If it is buffered, then the process returns to step 93 and the ID of the 
q next EDL segment is read. If the segment is not buffered, then in a next step 95 the application 
15 j=* uses the TSM API to request a partial object recall of the proper file segment from theMPEG2 
storage area, and upon receipt, modifies the data to make the segment a valid MPEG2 file in the 
same format as stored. As previously noted, only the relevant segment and some additional 
buffer are retrieved from tape. This process continues until all segments of the EDL have been 
retrieved, as indicated by step 96. 
20 Wrap-up. When all MPEG2 files segments have been recalled, the EDL file is closed 97. 

The MPEG2 files are then transferred in a next step 99 to a Profile decoder 34, for example via 
file transfer protocol over a fibre channel connection. 



5 



Recall Software. The MPEG2 Recall Software comprises custom software written by 




the Edit/Selection station 32. 
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V. Profile / Edit Bay 



Referring back to Fig. 5, the Profile decoding machine 34 reads theMPEG2 file from its 
disk, converts it to MJPEG and sends the serial digital output to the Edit Bay 35 for final editing. 
A producer accesses the files put on the Profile by the MPEG2 Recall operation. 

Hardware. The profile decoder 34 of the present embodiment comprises an MPEG2 
decoder 34 with a multi-channel hard drive controller and the Edit Bay station 35 comprises a PC 
which exercise control over the decoder 34. 

In conclusion, the system described provides an efficient, end-to-end content editing and 
production solution 
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